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Abstract 


In this paper, a novel hybrid iterative scheme to find approximate optimal 
distributed control governed by wave equations is considered. A partition of 
the time-control space is considered and the discrete form of the problem 
is converted to a quasi assignment problem. Then a population based al- 
gorithm, with a finite difference method, is applied to extract approximate 
optimal distributed control as a piecewise linear function. A convergence 
analysis is proposed for discretized form of the original problem. Numerical 
computations are given to show the proficiency of the proposed algorithm and 
the obtained results applying two popular evolutionary algorithms, genetic 
and particle swarm optimization algorithms. 


Keywords: Optimal control problem; Evolutionary algorithm; Finite differ- 
ence method; Wave equation 


1 Introduction 


In the past few decades, the science and engineering have witnessed a phe- 
nomenal growth in the field of optimal control problems (OCPs) governed 
by partial differential equations (PDEs), specially parabolic and hyperbolic 
equations. A large part of these improvements is due to the efforts of pioneer 
researchers such as J. L. Lions [15, 16, 17] and D. L. Russell [19, 20]. 

In particular, the controllability in wave equations are studied in [21, 22]. 
Kim and Erzberger [14] derived Riccati equation for optimum boundary con- 
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trol of wave equation, with quadratic cost function. Applicability of Laplace 
transform for determination of time optimal control for hyperbolic class of 
problems has been shown in [10]. But solving optimal control problems gov- 
erned by wave equations with analytical approaches, have some difficulties 
such as computing gradient, integrals in hyperbolic and parabolic equations 
and target functionals. For overcoming complexities due to the analytical ap- 
proaches, the numerical approaches are created based on various techniques 
as regularization [9, 8, 11], measure theoretical concepts [1, 5, 6] and penalty 
method [12]. 


Recently, nature-inspired optimization methods have attracted more and 
more attention and these powerful tools have been applied for solving a wide 
range of OCPs [2, 3, 7]. 


In this paper, by combinating one of the population based algorithms 
(Evolutionary Algorithms (EAs)) and a numerical method for solving wave 
equations (finite difference method), an effective numerical scheme for finding 
approximate optimal control and state functions has been procreated for 
OCPs governed by wave equations with a distributed control and a non- 
classical boundary condition as follows: 


T pL 
minimize J(v(.,.)) -{ | O(t,x,v(x,t)) dx dt (1) 
subject to u(x,t) = Ure(a,t)+v(a,t), (x,t) € [0, LZ] x [0,7] (2) 
u(z, 0) = p(x), ur (2, 0) = ¥(2), € (0, L] (3) 
u(0, t) = u(t), Ue (L, t) ux (0, t) = (t), te (0, T| (4) 


where v(x), w(x), u(t), n(t) are given functions and v(x, t) is a bounded dis- 
tributed control and gets its values in the interval V C R. The purpose is to 
find the approximate optimal control v(a,t) and state u(#,t) that minimize 
the functional (1) and satisfy the wave equation (2) with initial conditions 
(3), boundary conditions (4) and terminal conditions 


u(x, T) = w(2), u(a,T) = ¢(2). (5) 


Here w(x) and ¢(x) are target functions. 


The paper is organized as follows. In Sec. 2, we describe the discretiza- 
tion of optimal distributed control problem governed by wave equation. The 
problem is considered as a quasi assignment problem. The convergence of 
this modification is proved in the third section. In Sec. 4, we present the 
algorithm for solving OCP (1)-(5). In Sec. 5, numerical results arising from 
applying and comparing the given algorithm using two EAs, i.e. particle 
swarm optimization(PSO) and genetic algorithm(GA), are presented. 
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2 Description of the method 


To find the optimal solution we must examine the performance index in the 
set of all possibilities of control-state pairs. The set of admissible pairs con- 
sisting of pairs like (u, v) satisfying in (2)-(4) is denoted by P. In this section 
we consider a control space discretization based method considering equidis- 
tant partitions of [0,7], [0, Z] and V as A, = {0 = to, t1,--+ ,tn_-1,tn = Th 
Ag = {0 = £0,%1,°°* ,@m-1,Um = DL} and A, = {v0,v1,--+ , U1, Ww}, Te 
spectively. Now the main problem can be considered as a quasi assignment 
problem, where a performance index can be assigned corresponding to each 
chosen partition and choosing the best performance index can lead to deter- 
mine the near optimal control of the problem. A trivial way to determine 
the near optimal solution is to calculate all possible partitions and compare 
the corresponding trade offs. This trivial method of total enumeration needs 
((m+1)(n+1))“* evaluation. A typical discretization is given in Figure 


Figure 1: A typical control function in time-control space 


1 with n = 4, m = 6 and / = 5. To avoid so many computations, we use 
the EAs for evaluating special partitions that guides us to the optimal one. 
For each partition of control we need its corresponding trajectory to evaluate 
the performance index. Trivially, the corresponding trajectory should be in 
discretized form. 


For discretization of the wave equation (2)-(4), we use an approximate 
method like finite difference method as central difference approximation for 
the second partial derivative and forward difference approximation for the 
first partial derivative. By this method, 
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where ul = u(ai,tj), i = 9(as), Yi = b(ai),w = u(t), 7 = n(t;) and 
J 


i! = v(a;,t;). Then we have 


uy = Pi, u; = ky, +up, i=0,1,---,m, (6) 

uh = My, waa = hy +u), tu} — ud, § =0,1,---,n, (7) 
and . . . * . * 

ult) = ud + (2—2d2)ud + Pud_, — ul + BD, (8) 


where j = 1,2,--- ,n, =0,1,---,mandX\=k/h. 


If (u,7) be a pair of the trajectory and the control which satisfies in 
(10)-(11) and 


w(2)|| <e 1=0,1,--- ,m™m (9) 


I|u(xi, tn) 
tn) — C(a)I| Se 1=0,1,---,m (10) 


I|e (2, tr) 
for given small numbers €,; > 0 and eg > 0, then we can claim that, a good 


approximate pair for minimizing functional J in (1) has been found. Here 
|| - || is the infinity norm. 


Also in (1), the integral term can be estimated by a numerical method 
of integration, e.g. one of Newton-Cotes methods. After discretization of 
the OCP governed by wave equation, the problem is converted to opti- 
mization problem with two extra objective functions. We add the terms, 
ag |u(ai,tn) — w(a;)|| and Sane |uz(2i, tn) — ¢(a;)|| to the original ob- 
jective function and then, we apply EAs for this new criteria function. There- 
fore, by applying the above method, the OCP governed by wave equation is 
converted to constrained programming: 


(CP) min one O(t;,2;, 02) (11) 


+ MJ~ ju? — w(2i)|| + WS Mui, tr) — Cell 


i=1 i=l 
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subject to uit? = Mul, + (2—2d7)ud + MPul_, — ud > +k?p}, (12) 
ue = Pi, ut = ky, + v2, ~=0,1,-- 74m, (13) 
us = pj, U way = hy +us, t+uj —ui, 7 =0,1,- n, (14) 


where, A; and B; are the weights of a numerical method of integration, MZ 
and W are large positive numbers (as the parameters in penalty function 
approach). 


3 Convergence 


The solution of (CP) approximates the original problem by minimizing 
J(u,v) over the subset Py of e consists of all piecewise linear functions 
u(.,.) and v(.,.) with nodes at uJ,77,j = 0,1,---,N,i =0,1,---,N which 
satisfies (11) and the objective function (11) for this nodes called Jn, here 
without loss of generality, we assume that N =m =n. Our first aim is to 
show that P, C Pz C P3--- in an embedding fashion. 


Lemma 1. There exists an embedding that maps Py to a subset of Pn+i 
for all N = 1,2,---. 


Proof. For simplicity, we prove the case when N = 1. The proof for N > 2 is 
obtained analogously. 

Let consider an arbitrary pair (u,v) in P; represented by u,v . 7 =0,1i= 
0,1. We have to find a corresponding pair (t,%) in Po with wv j = 


0,1,2,7 = 0,1,2, as nodes that corresponds to (u,v). We have from (11) 


ult? = Mud + (2—-2d7)u? + Pul_, — uf * +h, 7 =0,1, 1=0,1, 
where uJt* = 
satisfies 


u(a;,t;+1). On the other hand, a typical element (t, 7) in P2 


a = a}, +(2-2)7)a) +7 a)_, a7 +P, 7 =0,1,2, 1=0,1,2, 
where ue = = ti(4i, tj41). 

It is clear that here we have @; = x;,1 = 0,1 and t; = t;,7 = 0,1. Therefore 
we can choose t,7,7 = 0,1,2,i = 0,1,2 in such a way that 


494) 


4.3 


This shows that the constructed pair (a, /) corresponds to (u,v) and belongs 
to P2. 


The above lemma has an important result in decreasing behavior of the 
optimal value of the objective function which leads to the following theorem. 
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Theorem 1. [f un = infp, Jn for N = 1,2,---, and w* = infp J exists, 


then limy 359 Ln = L*. 


Proof. By Lemma 1, we have py > pig > ++: => w*. So, this decreasing and 
bounded sequence converges to a limit w° > y*. It is enough to show that 
po = p*. Tf u° > p*, then e = w°—p* > 0 and by continuity of J(u, v), we may 
find a pair (u/,,,v2,), such that |J(ud,,v4,)-—w*| <, then J(ui,,,v2,) < p°, 
and so [ln < “° which is incorrect and therefore ° = p*. 


4 Algorithm of the approach 


In this section, an algorithm on the basis of the previous discussions is pre- 
sented. This algorithm is designed in two stages, initialization step and main 
steps, where the main steps contain the main structure of algorithm consid- 
ering initialization step. 

Initialization step: 

Choose an equidistant partition for time interval [0,7], with parameter dis- 
cretization k = t;41 —tj;, 7 =0,1,--- ,n—1 and an equidistant partition for 
interval [0, ZL], with parameter h = 241 —2;, 7=0,1,---,m—1. 

Main steps: 

Step 1. Choose a population randomly. 

Step 2. Compute u?, 7 =0,1,--- ,n, 1=0,--+ ,m, using (10)-(11). 

Step 3. Fitness scores are assigned to each population using objective func- 
tion of (CP). 

Step 4. Apply the rules of EA for current population. 

Step 5. Consider the new population as the current population. 

Step 6. If the termination conditions are satisfied, stop; otherwise jump to 
Step 2. 


5 Numerical results 


In this section the proposed algorithm in the previous section is examined by 
one numerical example. We have applied PSO and GA as two of the most 
popular EAs. 

Consider the following OCP: 
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subject to Un (a, t) = Ure (a, t) + (a,t), (x,t) € (0,1) x (0,1) 
u(z,0)=0, wu(z,0)=0, x € (0,1) 
u(0,t)=0, wuaz(1,t) =uz(0,t), te (0,1) 
u(az,T) =sin(27rx), u(a#,T)=sin(4rx),  t € (0,1) 


For analytical solution of this example, see [13]. 
Our solutions by PSO and GA algorithms are shown in the following 
tables: 


e where wave parameters, A, be 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9, 1.0 
and the population sizes, (m), be 200 and the number of iterations,(kmaz), 
be 500, results are shown in Table 1. 1. 


where the population size,(m), be 50, 100, 150, 200, 250, 300, 350 and the 
number of iterations,(kmaz), be 500 and parameter wave equation,A, be 
0.2, results are shown in Table 2. 2. 


e where the number of iterations,(kKmaz), be 100, 200, 300, 400, 500, 600, 700 
and the population size,(m), be 200 and parameter wave equation,), 
be 0.2, results are shown in Table 3. 3. 
Also comparison between w(x) and ¢(a) with u(x,T) and uz( are shown 


x,T 
in Figures 2 and 3 ,respectively, when m = 200, kmax = 500, A = 


) 
0.2 


Table 1: Comparison of the errors due to = PSO and GA with increasing 


as ||ur(x, T) Ze oe 
FPSO 

[a eos ae | 

[03 2at8e— 005 [0.53006 — 005 | 

[0.3 [5.55656 — 005 [1-08 — 004] 

[0d [2.20526 — ood | 8. 0804e — 005 | 


[05139876 — 00892016 — 005 | 
[06 | _9.6521¢—005 [7.865% — 005 | 
[07 [1 s01e— 00 [8.39596 — 005 | 
[08 [13052 — 00 [T1785e — 004 | 
[091.6008 —o0d_[T18tre — 005 | 
[_10__[ 2.41000 — 00 _[2.50276 — 004 | 
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Table 2: Comparison of the errors due to applying PSO and GA with increasing the 


number of population 


number of ||ur(a, T) 
population | = =PS5SO. | 


80 Sor 
| 50. ‘| 1.8470e— 004 | 2.16684e — 004 || 
| 100 | 1.1513e—004 | 9.4944e—005 | 
|_ 150 | 1.5074e— 004 | 1.0690e — 004 || 


[200 | 9.4195 — 005 [8.53666 — 005 
[250 | 1.518¢— 004 | 12451e— 004 | 
[__300__| 1.6264 — 004 | 1.0645¢ —004 | 
[350] 5.05566 —005_[_ 8.6299 —005_| 


Table 3: Comparison of the errors due to applying PSO and GA with increasing the 


number of iterations 


fee llue(a,T) — ¢(@)I| | 
iterations [PSO [__G&___] 
[100 [238d — 00 [A 01D2e — 004 | 
[20 [9.45% — 005 _[ 1.15046 — 00 | 
[300 [T8058 —o0d_[ 1.07476 — 004 | 


[400 __[_ 12746 —004_[ T0186 — 004 
[500 | 2.175te— 004 [9.14076 — 005 | 
[600 [10138 — 004 [7.7138 — 005 | 
[700 [9.9944e — 005 _[9.27H0e — 005 | 


6 Conclusion 


In this paper, a hybrid approach for the resolution of OCPs governed by 
wave equations is presented. This approach is based on partitioning of the 
time-control space, finite difference method, penalty method and EAs. The 
derived results show the superiority of the approach. 


Population based algorithms for approximate optimal ... 39 


— — — Exact u,(x,T) ; 
—~*— PSO u,(x,T) 


—o— GA u(,T) 


ie) 0.2 0.4 0.6 0.8 1 


Figure 2: Diagram of u(z,T) and w(x) 


— — = Exact u(x,T) 
—*— PSO u(x,T) 
—6— GA u(x,T) 


0.5 


-0.5 
-1 
15 
i?) 0.2 0.4 0.6 0.8 1 
Figure 3: Diagram of u;(x,T) and ¢(x) 
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